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Abstract 

This paper deals with numerical solutions of maximizing expected utility from ter- 
minal wealth under a non-bankruptcy constraint. The wealth process is subject to 
shocks produced by a general marked point process. The problem of the agent is to 
derive the optimal insurance strategy which allows "lowering" the level of the shocks. 
This optimization problem is related to a suitable dual stochastic control problem in 
which the delicate boundary constraints disappear. In Mnif [TJ], the dual value function 
is characterized as the unique viscosity solution of the corresponding Hamilton Jacobi 
Bellman Variational Inequality (HJBVI in short). We characterize the optimal insur- 
ance strategy by the solution of the variational inequality which we solve numerically 
by using an algorithm based on policy iterations. 
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1 Introduction 



We study the optimal insurance demand problem of an agent whose wealth is subject to 
shocks produced by some marked point process. Such a problem was formulated by Bryis 
[3j in continuous-time with Poisson shocks. Gollier [10] studied a similar problem where 
shocks are not proportional to wealth. An explicit solution to the problem is provided 
by Bryis by writing the associated Hamilton-Jacobi-Bellman (HJB in short) equation. In 
Bryis [3 J and Gollier |10] , they modeled the insurance premium by an affine function of the 
insurance strategy 9 = (0t)t£[o,T] which is the rate of insurance decided to be covered by 
the agent. If the agent is subject to some accident at time t which costs an amount Z, then 
he will pay 6tZ and the insurance company reimburses the amount (1 — 6t)Z. They didn't 
assume any constraint on the insurance strategy which is not realistic. 
In risk theory, Hipp and Plum [5 J analysed the trading strategy, in risky assets, which 
is optimal with respect to the criterion of minimizing the ruin probability. They derived 
the HJB equation related to this problem and proved the existence of a solution and a 
verification theorem. When the claims are exponentially distributed, the ruin probability 
decreases exponentially and the optimal amount invested in risky assets converges to a con- 
stant independent of the reserve level. Hipp and Schmidli [6] have obtained the asymptotic 
behaviour of the ruin probability under the optimal investment strategy in the small claim 
case. Schmidli [TB] studied the optimal proportional reinsurance policy which minimizes 
the ruin probability in infinite horizon. He derived the associated HJB equation, proved 
the existence of a solution and a verification theorem in the diffusion case. He proved that 
the ruin probability decreases exponentially whereas the optimal proportion to insure is 
constant. Moreover, he gave some conjecture in the Cramer-Lundberg case. Hojgaard and 
Taksar [7] studied another problem of proportional reinsurance. They considered the issue 
of reinsurance optimal fraction, that maximizes the return function. They modelled the 
reserve process as a diffusion process. 

In this paper, we model the claims by using a compound Poisson process. The insur- 
ance trading strategy is constrained to remain in [0,1]. We impose a constraint of non- 
bankruptcy on the wealth process X% of the agent for all t. The objective of the agent is to 
maximize the expected utility of the terminal wealth over all admissible strategies and to 
determine the optimal policy of insurance. 

In Mnif [H], we studied the latter stochastic control problem with state constraint by du- 
ality methods. Duality method was introduced by Karatzas et al. [12] and Cox and Huang 
We characterized the dual value function by a PDE approach as the unique solution 
of the associated HJBVI. In this paper, we determine numerically the optimal strategy of 
investment and the optimal reserve process. Usually, the optimal strategy is determined in 
a feedback form by using the primal approach and solving the associated HJB equation. 
The originality of this work and thanks to a verification theorem, the optimal reserve pro- 
cess is related to the derivative of the dual value function with respect to the dual state 
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variable. When the shocks are modeled by a Poisson process, we can obtain an explicit 
expression of the optimal strategy of insurance in terms of the dual value function . The 
paper is organized as follows. Section 2 describes the model. In Section 3, we formulate 
the dual optimization problem and we derive the associated HJBVI for the value function. 
In Section 4, we prove a verification theorem. We show that if there exists a solution to 
the HJBVI, then subject to some regularity conditions, it is the value function of the dual 
problem. The optimal insurance strategy could be characterized completely by the value 
function of the dual problem. Section 5 is devoted to a numerical analysis of the HJBVI: 
The HJBVI is discretized by using finite difference schemes and solved by using an algo- 
rithm based on the "Howard algorithm" ( policy iteration). Numerical results are presented. 
They provide the optimal insurance strategy and the optimal wealth process of the agent. 

2 Problem formulation 

Let (Q, T, P) be a complete probability space. We assume that the claims are generated by 
a compound Poisson process. More precisely, we consider an integer-valued random measure 
fi(dt, dz) with compensator ir(dz)dt. We assume that n(dz) = gG(dz) where G(dz) is a 
probability distribution on the bounded set C C iR + and g is a positive constant. In this 
case, the integral, with respect to the random measure fi(dt,dz), is simply a compound 
Poisson process: we have J * f c zfi(du,dz) = Yli^i^ii where N = {N t ,t > 0} is a Poisson 
process with intensity q and {Zi,i £ IV} is a sequence of random variables with common 
distribution G which represent the claim sizes. 

Let T > be a finite time horizon. We denote by IF = (J r t)o<t<T the filtration generated 
by the random measure fi(dt, dz). 

By definition of the intensity ir(dz)dt, the compensated jump process: 

fl(dt,dz) := n(dt,dz) — i:(dz)dt 

is such that {/x([0, x B), < t < T} is a (P,JF) martingale for all B eC, where C is the 
Borel a- field on C . 

An insurance strategy is a predictable process 9 = (0i)o<t<T which represents the rate 
of insurance covered by the agent. We assume that the insurance premium is an affine 
function of the insurance strategy. Given an initial wealth x > at time t and an insurance 
strategy 9, the wealth process of the agent at time s <G [t,T] is then given by : 

Xl^ e ■= x + (a - 13(1 - 9 U )) du - \ \ 9 u zfi(du,dz). (2.1) 
Jt Jt Jc 

We assume that a > (3 > which means that the premium rate received by the agent is 

lower then the premium rate paid to the insurer. In the literature, this problem is known 

as a proportional reinsurance one. The agent is an insurer who has to pay a premium to 

the reinsurer. We impose that the insurance strategy satisfies: 

9 S G [0, 1] a.s. for all t < s < T. (2.2) 
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We also impose the following non-bankruptcy constraint on the wealth process: 

Xl' x ' e > a.s. for alU < s < T. (2.3) 

Given an initial wealth x > at time t, an admissible policy 9 is a predictable stochastic 
process (O s )t< s <T , such that conditions (|2.2p and ()2.3|) are satisfied. We denote by A{t,x) 
the set of all admissible policies and S(t,x) := {X t,x ' e such that 9 £ A(t, x)}. 
Our agent has preferences modeled by a utility function U. 

Assumption 2.1 We assume that the agent's utility is described by a CRRA utility func- 
tion i.e. U(x) = —, where rj £ (0, 1). 

We denote by / the inverse of U' and we introduce the conjugate function of U defined by 

U{y) := sup{U(x) - xy}, y>0 
= U(I(y))-yI(y). 

y-l 

A straightforward calculus shows that U(y) = where 7 = -A- and U'(y) 

all y > 0. 

The objective of the agent is to find the value function which is defined as 

v(t,x):= sup E(U(X^ X ' 8 )). 
6eA(t,x) 

3 Dual optimization problem 

First we introduce some notations. Let x > and t € [0, T]. We denote by V(S(t,x)) the 
set of all probability measures Q ~ P with the following property: there exists A £ I p , set 
of non-decreasing predictable processes with A = 0, such that : 

X — A is a Q — local super-martingale for any X £ <S(t, x). (3-1) 

The upper variation process of x) under Q £ V(S{t, x)) is the element Jl 5 ^' 2 ^ (Q) in X p 
satisfying (pTTj) and such that A - A 5 ^ 2 -') (Q) £ I p for any A £ l p satisfying (f3TT|) . 
From Lemma 2.1 of Follmer and Kramkov [9], we can derive V(S(t,x)) and A s( f' x \Q). This 
result states that Q £ V(S(t, x)) iff there is an upper bound for all the predictable processes 
arising in the Doob-Meyer decomposition of the special semi-martingale V £ S(t, x) under 
Q. In this case, the upper variation process is equal to this upper bound. 
It is well-known from the martingale representation theorem for random measures (see e.g. 
Bremaud [2]) that all probability measures Q ~ P have a density process in the form : 

ZP = s(J J^ Pu (z)-l)fl(du,dz) \ , sE[t,T], (3.2) 

where p £ Ut = {(p s (z)) t < s <T predictable process : p s (z) > 0, a.s., t < s < T,z £ C, 
It Ic (U°SPs(^)| + Ps{z)n(dz) jds < 00 and E[Z%] = 1}. 



(2.4) 

= -i(y) for 

(2.5) 
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By Girsanov's theorem, the predictable compensator of an element X 9 G S(t, x) under P p 
= Z P T .P is : 

A p / = / (a-/3)du+ / e u (/3- / p u (z) z i:{dz))du. 
Jt Jt Jc 

We deduce from Lemma 2.1 of Follmer and Kramkov [9] that V(S(t,x)) = {P p : p G Ut\ 
and the upper variation process of P p is : 



A s s ^' x \P p ) 



From the non-decreasing property of U, we have 



(a — (3)du + / (/3 — / p u (z) z ir(dz)) + du. 



c 



v(t,x) = sup 

ec + (t,ir) 

where C+(t,x) = {# G ^+(^r) : *t X,S ^ Ha - S - for 61 6 -4(*,a?)}. Mnif and Pham [15] gave 
the following dual characterization of the set C+(t,x) 



H G C + (t,x) 

J{H) := sup E 

ZeV°(t,x) ,r£7i 



(3.3) 



Z T H1 



T=T 



Z u (a-/3 + (j3- / p u {z) zn{dz)) + )du 



c 



< X, 



where V°(t,x) is the subset of elements P p G V(S(t,x)) such that A^ t ' x \p p ) is bounded 
and 7* is the set of all stopping times valued in [0, T]. 
Following Mnif |14| . the dual problem of (|2.5p is written as: 



v(t, y) := inf E 
y,yj Ye yo {t) 



U(yY?> D )+ I y Y p ' D (a-(3 + ((3- I p u (z) z n(dz))+)d 



c 



(3.4) 



where 



y°(t) := {Y p ' D = Z p D, Z p G V°(t,x), D G £><}, 



and V t the set of nonnegative, nonincreasing predictable and cadlag processes D = (D s ) t < s <T 
with Dt = 1. We shall adopt a dynamic programming principle approach to study the dual 
value function (|3.4p . We recall the dynamic programming principle for our stochastic con- 
trol problem: for any stopping time < r < T, < t <T and < h < T — t, 



v(t,y) 



inf E 

YP' D ey°(t) 



v((t + h)Ar,Yf t f h)Ar ) 



(3.5) 



+ 



(t+h)AT 



YP> D (a-/3+ 1/9- / p u (^7r(<fe) 



where a A 6 = min(a, 6) ( see e.g. Fleming and Soner [8]). 

We denote by Ct the set of adapted processes (L s ) t < s <T with possible jump at time s = t 
and satisfying the equation 

dD s . 



dL. q 



D., 



"1{D S >0}> t < s <T, L t 



0. 



(3.6) 
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The Hamilton Jacobi Bellman Variational Inequality arising from the dynamic program- 
ming principle f)3.5j) is written as 

( dv ( dv \ dv 1 

minj — (t,y) + H Uy,v,— j ,-— (t,y)\ = 0, (t,y) G [0,T) x (0,oo), (3.7) 

with terminal condition 

v(T,y) = U(y),ye(p,oo), (3.8) 

where 

H (t, y, v, |^ := mf Ia" (t, y, v, ^) + y (a - p + (0 - J p{z) z 7r(d*))+) | , 

A" (t, y, v, ^\ := J (v(t, p(z)y) - v(t, y) - (p(z) - l)y^(t, y)j 7r(dz), 

and £ := |p positive Borel function defined on C s.t. j c ^| log + p(z)\ir(dz) < oo j. 
This divides the time-space solvency region [0, T) x (0, oo) into a no-jump region 

( dv ( dv 

Rl = Ut,y) G [0,T] x (0,oo), s.t. —(t,y)+H\t,y,v,— 

and a jump region 

i? 2 = | (t, y) G [0, T] x (0, oo), s.t. — (t, y) = 

In Mnif |14| , The dual value function is characterized as the unique viscosity solution of the 
associated HJBVI (|3. 7|) - (|3.8j) in the set of functions Z) 7 ([0,T] x (0, oo)) defined as follows: 

D 7 (\0,T] x (0,oo)) := \f : [0,31 * x(0,oo) -> such that 



([0,T] x (0,oo)) :={/:[0,T]*x(0,oo) 



\f(t,y)\ ^ , |/(*,x)-/(t,y)| -l 
sup < oo and sup r — -r ttttt < 00 r • 

2/>oy + y- 7 x>0,y>0 |x-y|(l + X-(T +1 ) +y-(7+l)) J 

4 Verification Theorem 

The main result of this section is the following verification theorem. It characterizes the 
optimal wealth process. When we model the jump by a Poisson process, the optimal 
insurance strategy is expressed in terms of the HJBVI solution. Our stochastic control 
problem is unusual, in the sense that, the control p is unbounded predictable process and 
L, given by (|3.6p . is also unbounded. For technical reason, we need to add the following 
integrability conditions that we will check later in the case of Poisson process. 

Assumption 4.1 we fix t G [0, T] and (p, D) &Uf x T> t . We assume that : 

(i) for all 7' > 27, we have E[exp(j Lt)\ < 00, 

(ii) there exist two Borel functions C\„, C2p such that 

Ci p (z) < ps(z) < C 2p (z) ds®ir(dz) a.e., (s,z) G [t,T] x C, 
J c Cip(z)^ 1 ir(dz) < 00 and J c C2 P (z)7r(dz) < 00. 
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The following lemma states the growth condition of the dual value function v. 
Lemma 4.1 The dual value function v is locally bounded and satisfies 

sllp J^ <00 . (4.1) 
y>o y + U{y) 

Proof. See Appendix. □ 



Theorem 4.1 Suppose that there exists a solution to the HJBVI {3. 7\ ), denoted by v with 
terminal condition 

v(T,y) = U(y) for all y G (0, oo), 

dv 

such that v is continuously differ entiable w.r.t t and y, — is continuously differentiable 

dy 

w.r.t t and y in the no jump region R\ and v satisfies the growth condition (|4.ip . 
Suppose that A ssumption \4 .l\ holds. Suppose further that there exist a B or el function p G lit, 
a process D G T>t, t G [0, T] and a positive real y such that with probability 1 we have 

(s,yY s ) G Ri ds®dP a.s. s G [t,T], (4.2) 

T ^(s,yY s -)Y s -dL s = 0, (4.3) 
dv 

— (t,yY t ) + x = 0, (4.4) 
dy 

where Y := Z P D = ZD. Then v is the value function of the dual problem, (D,p) is the 
solution of the dual problem. The optimal wealth process is given by: 

dv 

X* = -—(s,yY s )ds®dP a.s. s G [t,T]. (4.5) 
dy 

Proof. See Appendix □ 

Remark 4.1 Hypothesis (14. 2|) means that ((s,yY s )) s£ [ t ^ stays in the no jump region 
almost surely. The process might have jumps in the region R2 but reaches immediately the 
region R\. 

Remark 4.2 Hypothesis (|4.3p means that the process D regulates the process Y and de- 
creases only when the wealth process hits zero. 
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Remark 4.3 If all the shocks have the same size denoted by 5, then the optimal insurance 
strategy is given by 

^(s, Ps yY s -) - ¥(s,yY s -) 
6* s = dy{ — 5 L dy{ ,U S 1 a.e. in s 6 [t,T]. (4.6) 
o 

Prom definition of L (see assumption I4.3p . L decreases only on the set {||(s,yYg) = 0} 
or on this set, we have jpz(s,yY s ) = and so —-^{s,yY s )D s dL s = 0. By Ito's lemma we 



obtain 



<9 2 D - - (? 2 

7j-2 (s, yY s )Y s dL s + g(p s - l)yY s —^ 2 

d 2 v , , ,dv , - , 5?) 



dX* s = ( Si yY s )Y s dL s + g(p s -l)yY s — ( S ,yY s )ds (4.7) 



-(s,yY s )ds - (—(s,p s yY s -) - — (s ,yY s -))dN s 



asay ay ay 

- <9 2 v - a 2 £> 
= £>(Ps - 1 )y y s^ 2 -(s,l" s )ds - Q-^--(s,yY s )ds 

- 9*5dN s . 

Using Hypothesis (|4.2p . the regularity on the function v and Ito's lemma, we have 

d^v " dv - dv 

-(s,yY s -) + ^(p s — (s,p s yY s -) - —(s,yY s -)) (4. 



ayas s dy ' s ay 

a?) ~ - <9 2 {> 

- 1 )^( s '^-) - p(p s - l )y Y s--Q^2{s,yy s 

+ (a - /3 + (/3 - ^/5 S )+) = 0. 



Plugging (]4.8p into (I4.7P and using (I4.4p . we obtain 



(a-P + (P- g5p u )+)du - 6*JdN u 



X* = x + 

+ J g5p u 9* u du, 
and so 6* is the optimal insurance strategy. 

Remark 4.4 If all the shocks have the same size denoted by 5, then the set lit is given by 
Ut = {(p s )t<s<T predictable process : p s > 0, a.s., t < s <T and E[Zj] = 1}. In this case 
Assumption 14. 1( h) is automatically checked. 



Remark 4.5 Theorem 5.1 of Mnif and Pham |15j could be viewed as a dual verification 
theorem which caracterizes the solution of the primal approach. The theorem 14.11 brings 
a new information by using PDE arguments which concerns the wealth process and the 
optimal strategy in the case of Poisson process. 

Example 4.1 If all the shocks have the same size denoted by 5 and if a = (3 = tt5 (cheap 
reinsurance), then the Hamiltonian H has the following expression 

H (t, V, v, ^\ = inf |tt (v(t, py) - v(t, y) - (p - l)y^{t, y)j + y/3(l - p) + \ 
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As it is seen in Lemma 4.1 in Mnif [TJ], the dual value function is convex in y and so 

/ dv \ 

7T lv(t, py) - v(t, y)-( P - l)v-Qjj(t, y)\ + yfi(l -p)+>0 

( dv\ 

and the equality is obtained when p = 1, In this case H [ t,y,v, — =0. The solution of 

V dyj 

the HJBVI (j3.7j) with terminal condition (|3.8[) is given by 

v(t,y) = U(y), 

and the solution of the dual problem is given by p = 1 and D = 1. From the Verification 
Theorem the optimal wealth process is given by X* = x, the insurance strategy 9* = and 
so Assumption 14.11 is checked. 



5 Numerical study 

Here we restrict ourselves to the case where the integer valued random measure p(dt, dz) 
is a Poisson process with constant intensity ir. All the claims have the same size denoted 
by 5. Our purpose is to solve the following variational inequality: 

min | y) + inf U"(t, y, v, + y (a - P + (/3 - ^tt) + ) | , y) | = 0, (5.1) 

for all (t,y) G [0, T) x (0, oo), with terminal condition v(T,y) = U(y), where 

dv ( dv \ 

A"(t, y, v,t^) = k [v(t, py) - v{t, y) - (p - l)y^-(t, y) . 

It is more appropriate to study numerically the function 

J(t,y) :=e- rt v(t,y), (5.2) 

where r is a positive constant. We will explain in Remark 15.21 the advantage of the intro- 
duction of the function J. We proceed with another technical change of variable which 
brings [0,7] x (0,oo) into [0,T] x (0,1), namely 



v(t,y) = J(t,y). 



The function v satisfies 



min y) + inf jl'(t, y, v, Dv) + j^—^ (a - (3 + {(3 - p5tt) + )} , 

-(l-y) 2 Dv(t,y)} = (5.3) 
for all (t,y) G [0,T) x (0,1), where 

A»(t, y, v, Dv) = vr (v(t, ^ - _ ) - y) - (p - 1)(1 - y)yDv(t, y)J - rv(t, y) 
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and Dv is the derivative of v with respect to the state variable. The terminal condition is 
given by 

v(T,y)= - \ (5.4) 
V ,y; 7 (1 -y)-i K ' 

for all y € (0,1). 

In Mnif j!4j, we have proved that the dual value function (|3.4|) . within a change of vari- 
ables, is the unique viscosity solution of variational inequality (|5.3j) . This solution can be 
approximated by the following numerical method: 

(i) approximate variational inequality (|5.3|) by using a consistent finite difference approx- 
imation which satisfies the discrete maximum principle (DMP) ( see Lapeyre, Sulem and 
Talay [13J ), 

(ii) solve the discrete equation by means of the Howard algorithm (policy iteration) (see 
Howard |llj). Finally a reverse change of variables is performed in order to display results 
of variational inequality (|5.1|) . 

5.1 Finite difference approximation 

Let h := (ht, hy) be the finite difference step in the time coordinate and the finite difference 
step in the state coordinate. The step ht is defined by h t := S , (N € IN*). Let M G M* 
be the number of discretization steps in the state coordinate ( hy is not uniform for all 
elements of the grid). Let (ti,yj),0 < i < N, I < j < M — lbe the points of the grid 
^iV,M-We choose a fully implicit ^-scheme. We consider an approximation scheme of (|5.3p 
of the following form: 

S(h, t, y, v h (t, y),v h ) = 0, (t, y) G Q NM , (5.5) 

where 

S(h, t, y, v\t, y),v h ) := min { ^ + h t ,y)-^y) _ ^ _ } 

+ inf {n(v h (t,Pr{ PV - )) - v h (t,y) + ((1 - p)(l - y)y)+D + v h (t,y) 
P >0 I V v l + y(p - I)' 

+ ((1 -p)(l- y)y)~D^v h (t, y)) + (a -/?+(/?- P 5n) + )} 

, -(l-y) 2 Dv h (t,y)}; 

D+ ^ {t ,y) := * h (t,y + hy)-,\t,y)^ D __ hm ;= ^(t,y)-^(t,y-hy)^ 

Hy Hy 

((! - P)i l ~ V)v)+ = max((l - p)(l - y)y,0) , ((1 - p){l - y)y)_ = max(-(l - p)(l - y)y, 
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and (f,Pr( 1+ -^_^ )) is the projection of (t, ) on the grid. We take v h {U,y M ) = 

v h (ti,yM-2) for all < i < iV — 1. For terminal condition, we set 

—rT — 7 

v h (T, yA = -4 % — for all 1< j < M - 1. 

The approximation (|5.5[) leads to a system of N x (M — 1) equations with iV x (M — 1) 
unknowns {v h (ti,yj) , < i < N - 1, 1 < j < M - 1}: 

min - u A (ti, jy) + nun [h t A p ^v h {U, Vj ) + Wfe)} , Bv h (U, Vj)\ = 0, (5.6) 

for all < i < N — 1,1 < j < M — 1, with terminal condition: 

— rT — 7 

v h (T, y 3 ) = - Vj for all 1 < j < M - 1, 
7(1-%') 7 

where M p = {(pij)o<i<N-i , i<j<M-i, Pij > 0}, A p ' u is the (M - 1) x (M - 1) matrix 
associated to the approximation of the operator A p at time tj, l p is (M — 1) vector such 
that 

lP(yj) = —^(a -0 + (p- p5vr) + ), for all 1 < j < M - 1 
1 — Vj 

and B is a (M — 1) x (M — 1) matrix associated to the second term of our variational 
inequality, which verifies 

B(j,j) = -^4 — for all 2 < j < M - 1 
B(j j - 1) = ^4 — for all 2 < j < M - 1 
B(i,j) = if not . 

Let A p denote the set of control functions p : &n,m — > -M p - The system of equations 
(15. 6p can be written as a system of N stationary inequalities: 



mm < v 



j^Mi+i _ d h,u + m jn ^h t A p ' u v h ' u + h t l p } , Bv h ' u j = 0, (5.7) 



for all i = 0...N — 1, with terminal condition: 

—rT — 7 

where v h,ti a vector which approximates (v(ti, j/j))i=i— M— l- 

The convergence of the numerical scheme in not proved in our situation as in the case of 
Tourin and Zariphopoulou [T7] ( They studied numerical schemes for investment consump- 
tion models with transaction costs). The system of N stationary inequalities (|5.7p can be 
solved by Howard algorithms. We describe below this algorithm. 
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Remark 5.1 Barles and Souganidis |T] proved that a numerical scheme consistent mono- 
tone and stable converges to the unique viscosity solution of the HJB since a comparison 
theorem holds for the limiting equation in class of bounded functions. In our case, the 
dual value function is not bounded and it is not obvious that the semi-relaxed limits of our 
sequence is in the space -D 7 ([0,T] x (0, oo)) 

Remark 5.2 The introduction of the function J (see equality (|5.2p ). insures that the 
matrix A p,ti ,i = 0...N — 1 is diagonally dominant. 

5.2 The Howard algorithm 

To solve Equation (|5.7p . we use the Howard algorithm (see Lapeyre Sulem and Talay [13J), 
also named policy iteration. 

It consists on computing two sequences ( / o* i ' n ) ne jv and (v ' ti,n ) n& ]^,i = 0...N — 1, (starting 
from i = 0...N — 1) defined by: 

• Step 2n — 1. To v h,ti,n is associated another strategy p ti,n 

p u ' n G arg min I A p ' ti v h ' ti ' n + l p ' n \ , i = 0...N - 1. 
peAp I J 

• Step 2n. To the strategy p ti,n , we compute a partition (D" U Dl]:) such that 

c Mi+i,n + (ji t A pti ' n,ti - I)v h ^ n + h t l pti ' n < Bv h ' u ' n , i = 0...N - 1, on Df, 

+ (h t AP H ' n ^ - I)v h ^ n + h t l pl ' H '" > Bv h ' u ' n , i = 0...N - 1, on D$. 
The solution y h ^^ n+1 \ s obtained by solving two linear systems: 

-M l+1 ,n+i + (h t A ph, "' u - I)v h ^ n+1 + h t l pH ' n = 0, i = 0...N - 1, on £>?, 

and 

Bv h ' k ' n+1 = 0, i = 0...N - 1, on D%. 

• If _ yh,ti,n^ < e , i = 0...N — 1, stop, otherwise, go to step In + 1. 

The convergence the Howard algorithm is obtained heuristically. We have no theoretical 
result for the convergence. The matrix arising after the discretization of the HJB VI does not 
satisfy the discrete maximum principle which is a sufficient condition for the convergence 
of such algorithm. 
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5.3 Algorithm for the optimal strategy 

After the numerical resolution of Variational Inequality (|5.3p . we compute the optimal 
strategy of insurance and the wealth process. Prom the Verification Theorem, we need to 
evaluate y and to construct the process {Yti)o<i<N-i- 

The optimal insurance strategy and the wealth process are given by formulas (|4,6p and 
(|4.5p . We describe below the algorithm. 
First step: Given an initial wealth x, 



we compute yj s.t (0, y J0 ) € &n,m and X(0,yj ) = x, 

where X{t hVj ) = -(1 - Vjf ( HU '%]zf.lf J " l) ) , < i < iV — 1 and I < j < M 



we compute y 



Second step: Let Zq = Dq = 1. For i = 1 to iV— 1, we construct the process = yZ^D^ 
as follows: 

• We compute — ^r 1 and we select the nearest point of the grid to (£$, — V 1 ). This 
point will be denoted by (U,^). 

• We determine the optimal control p which is obtained by Howard Algorithm at point 
(tiiVji)- We denote this control by pj i . 

• We evaluate Z ti = Z U _ Y exp {-irh{p ji - 1))(1 + {p ji - l)l{A j u(t i )=l})- We take D U = 

A i- 

• We compute ^^-i (resp y '~ ) and we select the point of the grid which is the 
nearest to (t{ Pj l V 1 ) (resp :— qfe ) • This point will be denoted by (U,y.i) (resp 

• We make the following instruction: while X(ti,y./t) < , we decrease the process 
Dfy. We denote by (U,y-//) the new point of the grid. 

• The optimal insurance strategy and the optimal wealth process are given by 

(5.8) 



X^=X(ti,yj)- (5-9) 

5.4 Numerical results 

Equation f)5. 1 1) is solved by using the Howard algorithm. Numerical tests are performed 
with the parameters given in Table [U We suppose that there are two claims at times t\ = | 
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Table 1: Values for the model's parameters 



V 


a 


P 


r 


5 


7T 


T 


0.5 


2.1 


2.15 


0.05 


1 


2 


1 



and t2 = |- We first choose a uniform discretization step in the state coordinate. It is equal 
to hy = p = jig. For the discretization step in time, we take h% = We compute the 
value of y and the corresponding index jo. Then we choose two discretization steps in the 
state coordinate. If y £ (0, (jo — 2)p\ U [(jo + 2)p, 1), we keep the same discretization step. 
If y £ [(jo — 2)p, (jo + 2)p], the discretization step is equal to hy = jggjj. We mention that 
the operation of choosing the point nearest to the grid is delicate which oblige us to reduce 
the discretization step in the zone [(jo — 2)p, (jo + 2)p\. The optimal insurance strategy 
and the optimal wealth process are displayed in Figures 1 and 2. At the claim, the optimal 
wealth process decreases only by the amount of the shock covered by the agent. We observe 
in Figure 1, that after the first claim (i = 0.4), the optimal insurance strategy falls, then 
it increases until a certain level reached at time t = 0.6. The agent who expects a new 
claim (the intensity is equal to 2), decides to reduce the fraction of the insurance strategy 
until a lower level then it increases. This explains the lack of monotony of the optimal 
insurance strategy. After the second claim (t = 0.8), the fraction of risk covered by the 
agent decreases again, then when we approach the horizon T, it increases. When we replace 
formulas (|5.9|) and (|5.8|) in the expression of the wealth process (|2.1|) . we obtain 

sup \X* U - XI _ (« - 0(1 - &Z))Ati + 0£A//(i<)| = 0.0107 

l<i<iV 
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insurance strategy 



0.7 



0.5 



0.2 




on 1 i 1 r 

0.1 0.2 



I 1 I 1 I 1 I 1 I 1 I 1 I ^ 
0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 

FIG. 1 . Optimal insurance strategy time 



wealth process 
4.5 




t 1 i 1 r 

0.1 0.2 0.3 0.4 0.5 0.6 

F1G.2. Optimal wealth process 



0.9 1.0 
time 
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6 Appendix 



6.1 Proof of Lemma 14.11 

Since the controls p s = 1 and D s = 1, s £ [t, T] lie in Ut X T>t, we have 

«(t,y) < U(y) + Ky, 



(6.1) 



where IT is a constant. 

Let (Z n := Z pn ,D n ) be a minimizing sequence of v(t,y). From the definition of these 
minimizing sequences, there exist e n and no £ IN such that e n — > when n — > oo and 
for all n > ng, we have 



v(t,y) > E[U(yZ%D2) 

[■T 

+ yE' 



P + (P- I P^(z)z7T(dz)) + )d U 

Jc 



(6.2) 



Since e n — > when n — > oo, there exists n\ £ IV such that for all n > n\, we have 
£n < ^(y) + V- We recall That C/(y) > U(0 + ) > and so U(y) + y > since y > 0. Using 
the boundedness of D n , Jensen's inequality and the martingale property of Z n , we have: 



E 



U(yZ%DZ)\ > U(yE[Z^}) 
> U{y). 



(6.3) 



For the second term of the r.h.s of inequality (|6.2p . since D™ < 1 for all s £ [t,T], using 
Fubini's theorem and the martingale property of Z n , we have 



E 



> y(a-f3)E 



E \Ztf\ du 



j yZ%D%( a -l3+(/3- ^ Pu (z)zTr(dz)) + )du 

> y{a-p) 

Jt 

> K'y, (6.4) 
where K' is a constant independent of y. Inequalities (j6.3j) and fj6.4j) imply that 

v(t,y)>U(y) + K'y. (6.5) 
From inequalities (|6.ip and (|6.5p . we deduce that 

\Ht,y)\ 



sup 



y >o y + U{y) 



< oo 



(6.6) 



□ 
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6.2 Proof of Theorem 1531 



The proof of the theorem is broken in three steps. Let t € [0, T] and y € (0, oo). 
First step: We show that 

v(t,y)< inf e\u( V YP' d )+ F y Y£ D (a - P + - [ p u (z) zir(dz)) + )du 
YP< D ty°(t) [ J t Jc 

Let YP- D e y°{t). Let 

r. = taf{« > * such that f »(U, P ^)VY- D ) - t^yY^Mi.) > „} A T. 

Jo 

Applying the generalized Ito's formula, we have 



(6.7) 



v(TAT n ,yYff T J + 

Dv 
du 



TAt„ 



yYP> D {a-P + {P- I Pu (z)z7r(dz)) + )du 



c 



TAt n 



TAr " dv D 
n-(u,yY£L )du 



TATn ^yy:- D )yy:- D dL u 



c 



dv ^ 
dy 



TAt„ 



'-(u,yYP: D )yY^ D (p u (z) - l)n(dz)du + £ (v(u,yY u ^ D ) - v(u,yY^ D )) 

t<u<TAr n 

yYP' D (a-P+({3- [ p u (z) zn(dz)) + )du 
Jc 

and so we have 

r-TAT„ r 

v(T A r n , yY£fj + J yY£ D {a - /3 + (J3 - j p u {z) z n(dz)) + )du 



+ 



+ 



v(t,y) 

TAr n 



TAr n 



— (u, yY u P> D ) + AP(u, yY u P< D ,v, — ) ) ds 



\du 



dy 



(6.8) 



yYP< D (a-(3 + ((3- I p u (z) z ir(dz))+)du 



c 



^ ^,yY* D )yY* D dL u 



v(u, Pu(z)yY?l D ) - v(u, yY^_ u )p(du, dz). 



c 



Since v is a classical solution of the variational inequality (|3.7p . we have 

^-(u, yY£ D ) + A'(u, yY u e> D ,v, ^) + yY£ D {a - f) + (0 - j p u (z) z n(dz))+) > 



and - ^-(u,yY^ D )Y^ D dL u > a.e. in u G [t,T]. 



Taking expectation in (|6.8p . we have 



v(t,y)<E 



v(T A T n ,yY£fj + / Y£°{a - (3 + (/3 - / p u {z) z n(dz)) + )du 



TAr n 



C 



for all Y P,D G y°(t). It remains to show that 



the family ( v(T A r n , yY£'P ) ) is uniformly integrable under P. 



~TAr n . 



(6.9) 
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We consider the function g{z) = z p , p > 1 will be chosen later, z > 0. By using Ito's 
formula and since the function U is a power utility function, we have 

cT 



g(u{Y£ D )) = g{U{y)) + J 1P g (u(vY£> D j) dL u 



(6.10) 



+ 



T 



g {u(yY?> D )) (p u (z)-^ - l) fi(du,dz) 



it Jc 

+ J f c g{u{yY^ D )){p u (z)-^-l + 1P (p u (z)-l))^dz)du. 



The solution of (|6.10p is given by the Doleans-Dade exponential formula 
g (u(yY?> D ) 



g{U (y))Z{ T exp ( -ypL T + 



t Jc 



{ Pu {z)- 1P - 1 + lp( P u(z) ~ 1)) 7T(dz)du\ , 



1 



< ^g(U{y))[{Z p lT Y + exp [2 1P L T + 2 jf J {p u {z)^ p - 1 + jp(p u (z) - 1)) n(dz)du 



where {Zi u )ue[t,T\ is a local martingale defined by 

{p u (z)-^-l)p(du,dz) 



t JC 



We choose P = where 7 is defined in Assumption I4.1f i) . From Assumption I4,lf ii) and 
by Jensen inequality, we have 



p s (z)-^ P 7T(dz) Yds 



T [ p s (z)-^ p ir(dz)ds < [ T 
10 Jc Jo x Jc 

and so by Assumption 14,11 there exists a positive constant C\ such that : 

l-T 



E 



exp ( 2~ :l >Lr + 2 I {ps{z)-~ (P - 1 + 7p(p s {z) - 1)) ir(dz)ds J < d- (6.11) 



From the definition of (Z p s ) s& hT]i we have 
Taking expectation under P and using Assumption 14. lfi i) . we obtain 



-u 1 - J J c Z L-(p^ z ) yp -1) p{du,dz) 



E 



< 2(l + J J \Z p lu \ 2 {pu(z)-™ - l)\(dz)du 

< 2(l + E j°\Z P Sdu). 
By Fubini's theorem and Gronwall's lemma , we have 



E 



<Ci 



(6.12) 
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From inequalities (|6.1ip and (|6.12p . we obtain that 



E 



9(U(yY£fj) <C ig (U(y)), 



and so 



sup E 

new 



9[U(yY£ 



D 

Tf\T n ■ 



< OO. 



(6.13) 

oo when x goes to 



Similarly, one can prove that sup E g (yYf'^. J < oo. Since 

infinity and from the growth condition (|4.ip , the property ()6.9[) holds. Sending n — > oo, 
we have r n — )• oo P a.s. By dominated convergence theorem, we have (|6.7p . 
Second step: We show that v is the dual value function and (p, D) is the solution of the 
dual problem i.e: 



v(t,y) 



E 



U{yY±) + [ yYfta-p + tf- [ p u \ 
Jt Jc 



z) zir(dz)) + )du\yY t = y 



(6.14) 



where Y% := ^, s £ [tiT]. We consider the processes p and D and the positive number y 
such that dH2D and hold. Then, we have 

— («,yy u ) + A"(u,yy u ,fi,— ) + $y u ( a - /3 + (0 - / p M (£) «7r(dz)) + ) = 



c 



dv 

and — —(u,yY u -)Y u -dL u = a.e. in u G [i, T . 



Let 



Taking expectation in (|6.8j) . we have 

fTAf„ 



f n = inf{n > t such that / v(s,yp s (z)Y s ) — v(s,yY s )ir{dz) > n}. 

Jc 



v(t,y) = E 



v(Tf\r n ,yY* A - n )+ y Ys \a-P + (f3- p s (z) z ir(dz)) + )ds\yY t = y 



c 



(6.15) 



Since the family [v(T A f n , yY^ A - n )J is uniformly integrable under P, equation (|6.15p 

implies (|6.14p and so (p, D) is the solution of the dual problem. 

dv 

Third step: We show that X* defined by X* := - — (s,yY s ), s G [t,T] is the solution of 
the primal problem. 

Following same arguments as in Lemma 6.6 of Mnif and Pham [15], we have from f)6. 14|) : 



dv 
dy 



(t,y) 



-E 



Y±I(yYi) - [ Y l a {a - + (0 - [ p u (z) z ir(dz)). 
Jt Jc 



)du 



(6.16) 



dv a dv 

J(I(yYj,)) = ——(t,y) and in particular I(yYp) £ C+(t,——(t,y)) (see characterization 



3.3p . Moreover, from definition of U and (|2.4p . we have for all H € C+(t,x) : 

U(H) < U(yY^) + yY^H 

= U(I(yY±)) - yY±I(yYi) + yY^H. 
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Hence, by taking expectation, we obtain : 

E[U(H)] < E[U(I(yY*))] + y(j(H) + ^(t,y) 
< E[U(I(yY±))], 

where we used expression of — (t, y) given in equation (|6.16p . expression of J(H) in Lemma 

dy 

dv 

3.2 in Mnif [14J, and the fact that J{H) < x = ~ — {t,y) (see equality From 
characterization 13.31 there exists 9* G A(t, x) such that : 

I(yYr) < X l /' e \ a.s. (6.17) 

Since YX t,x,e * — f t Y u (a> — (3 + (/3 — f c p u (z) z n{dz)) + )du is a supermartingale under P (see 
Lemma 3.1 in Mnif [Hj), we have : 



E 



■T 

Y^ x ' e * -I Y u (a-f3+(/3- I^p u (z)z7r(dz)) + )du 



< x. (6.18) 



From equation (|6.16p . and by (|6.17p . we actually have 

Y^x!f r = Y^I(yY£) a.s. 

and equality in (|6.18p . Therefore YX*'*' 9 * — J t Y u (a — /? + (/? — f c p u (z) zn(dz)) + )du is a 

martingale under P, and so relation X* = — — (s,yY s ) = X t,x,e holds for all s 6 [t,T]. □ 

'hi 
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